Image processing apparatus and controlling method of the same

ABSTRACT

An image processing apparatus and a controlling method of the same are provided. The method includes displaying a first screen corresponding to a first application; displaying a second screen corresponding to a second application above the first screen such that the second screen overlaps at least a portion of the first screen; and displaying at least a portion of the second screen that overlaps the portion of the first screen, while controlling the first application.

CROSS-REFERENCE TO RELATED APPLICATION

This is a divisional of a U.S. patent application Ser. No. 12/855,726,which claims priority from Korean Patent Applications No.10-2009-0083338, filed on Sep. 4, 2009 and No. 10-2010-0013520, filed onFeb. 12, 2010 in the Korean Intellectual Property Office, thedisclosures of which are incorporated herein by reference.

BACKGROUND

1. Field

Apparatuses and methods consistent with the exemplary embodiments relateto an image processing apparatus and a controlling method of the same,and more particularly, to an image processing apparatus and acontrolling method of the same, in which when a plurality ofapplications controllable on a digital television (DTV) or a personalcomputer (PC) are executed at a time, the respective applications aresimultaneously controlled through a single or a plurality of inputdevices, and cursors for simultaneously controlling the plurality ofapplications are displayed.

2. Description of the Related Art

As opposed to a related art analog-type TV that outputs and displaysjust one broadcasting image to a screen, a digital-type TV that hasappeared in recent years can display two or more broadcasting images andcontent images at the same time. Further, as a processing performance ofthe TV is enhanced and contents are diversified, a recent trend changesfrom a unilateral TV, in which a user can only passively view abroadcast, to an interactive TV in which the screen is controllable by auser through an input device such as a remote controller, a mouse, oretc.

Particularly, there has recently been proposed a method of providinginteractive contents such as a game, a digital contents management (DMC)or the like through the TV. However, a related art remote controllerwith only buttons is not sufficient to control such interactive contentsin the TV. Accordingly, there has also been proposed a method ofcontrolling the TV through an advanced input device having a higherdegree of freedom like a cursor, a pointer, etc.

Generally, when a plurality of programs is running in a PC, only onewindow or program is activated at a time. In this case, it is possibleto control only the activated window or program even if the pluralprograms are overlapped. Accordingly, one user may use and control theplurality of programs by directly switching the activated program.

However, if the plurality of programs are activated and needed to besimultaneously controlled independently of each other through the inputdevices, respectively, it is required to newly set up which cursor isassigned to which program and how the cursor operates.

SUMMARY

Accordingly, an aspect of the exemplary embodiments is to provide animage processing apparatus and a controlling method of the same, inwhich a plurality of applications can be controlled at the same timethrough one or a plurality of input devices in a DTV or a PC, and asingle or plural cursors for simultaneously controlling the plurality ofprograms output to a screen can be displayed and moved.

The foregoing and/or other aspects may be achieved by providing a methodof controlling an image processing apparatus, the method including:displaying a first screen corresponding to a first application;displaying a second screen corresponding to a second application abovethe first screen as overlapping each other; and displaying a part of thesecond screen, overlapped with the first screen, while controlling thefirst application.

In this method, at least one pointing cursor for controlling anapplication may be displayed on at least one of the first screen and thesecond screen. The pointing cursor may control an applicationcorresponding to the most adjacent screen between the underlying firstand second screens displayed overlapping each other. The pointing cursormay be movable to at least one location of below the first screen, abovethe first screen, between the first and second screens, and above thesecond screen. The pointing cursor may be changed in at least one oftransparency, shape, brightness and color when transferred. The at leastone pointing cursor may respectively correspond to at least one pointingdevice. The pointing cursor may include a first pointing cursor and asecond pointing cursor, and the first pointing cursor and the secondpointing cursor may control the first application and the secondapplication, respectively. The first pointing cursor and the secondpointing cursor may control an application corresponding to the mostadjacent screen between the underlying first and second screensdisplayed overlapping each other when no screen is displayedcorresponding to an application to be controlled. The first pointingcursor and the second pointing cursor may be changed in at least one oftransparency, shape, brightness and color when controlling anotherapplication other than an application subject to control. The firstpointing cursor and the second pointing cursor may be movable within aregion of a screen corresponding to an application subject to control.The first pointing cursor and the second pointing cursor may be changedin at least one of transparency, shape, brightness and color whentransferred beyond a movable region. The first pointing cursor and thesecond pointing cursor may correspond to a first pointing device and asecond pointing device, respectively.

Another aspect may be achieved by providing a method of controlling animage processing apparatus, the method including: displaying a firstscreen corresponding to a first application and a second screencorresponding to a second application not to overlap each other;controlling at least one of the first application and the secondapplication; and displaying an application to be recognizable by a userwhen the application subject to control is switched.

Still another aspect may be achieved by providing an image processingapparatus including an image processor which processes and displays animage; and a controller which controls the image processor to display asecond screen corresponding to a second application above a first screencorresponding to a first application as overlapping each other and todisplay a part of the second screen, overlapped with the first screen,when controlling the first application.

Yet another aspect may be achieved by providing an image processingapparatus including: an image processor which processes and displays animage; and a controller which controls the image processor to display afirst screen corresponding to a first application and a second screencorresponding to a second application not to overlap each other and todisplay an application to be recognizable by a user when the applicationsubject to control is switched while controls at least one of the firstapplication and the second application.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of an image processing apparatus according toan exemplary embodiment;

FIG. 2A shows a display in which one pointing cursor is displayed;

FIG. 2B shows a display in which the pointing cursor is changed in aform as being transferred between applications;

FIG. 2C shows a display in which two pointing cursors are displayed;

FIG. 2D shows a display in which a plurality of applications arecontrolled by a plurality of pointing devices, respectively;

FIG. 2E shows a display in which a screen corresponding to anapplication to be controlled is not displayed yet;

FIG. 2F shows a display including a region where a pointing cursor ismovable;

FIG. 3 shows a configuration of layers according to an exemplaryembodiment;

FIG. 4A shows a configuration of layers according to another exemplaryembodiment;

FIG. 4B shows a screen displayed in the case of FIG. 4A;

FIG. 5A shows a configuration of layers according to still anotherexemplary embodiment;

FIG. 5B shows a screen displayed in the case of FIG. 5A;

FIG. 6A shows a configuration of layers according to still anotherexemplary embodiment;

FIG. 6B shows a screen displayed in the case of FIG. 6A;

FIG. 7A shows a configuration of layers according to still anotherexemplary embodiment;

FIG. 7B shows a screen displayed in the case of FIG. 7A;

FIG. 8A shows a display in which one pointing cursor is displayed;

FIG. 8B shows a display in which the form of the pointing cursor ischanged as the cursor is transferred between applications;

FIG. 8C shows a display in which the plurality of applications arecontrolled by a plurality of pointing devices, respectively;

FIG. 8D shows a display in which the form of the pointing cursor ischanged when transferred beyond a target to be controlled;

FIG. 9 is a control flowchart of an image processing apparatus accordingto a first exemplary embodiment; and

FIG. 10 is a control flowchart of an image processing apparatusaccording to a second exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Below, exemplary embodiments will be described in detail with referenceto accompanying drawings so as to be easily realized by a person havingordinary knowledge in the art. The exemplary embodiments may be embodiedin various forms without being limited to the embodiments set forthherein. Descriptions of well-known parts are omitted for clarity, andlike reference numerals refer to like elements throughout. Expressionssuch as “at least one of,” when preceding a list of elements modify theentire list of elements and do not modify the individual elements of thelist.

FIG. 1 is a block diagram of an image processing apparatus according toan exemplary embodiment.

An image processing apparatus 100 in this embodiment includes a DTV, alarge format display (LFD), a desktop computer, a laptop computer, amobile terminal, a set-top box, etc. Further, any electronic apparatuscan be employed as the image processing apparatus 100 as long as it canexecute a plurality of applications and be controlled by a pointingdevice 150.

The image processing apparatus 100 in this exemplary embodiment includesan image processor 110, a user input unit 120 and a controller 130.

The image processor 110 can process and display an image. Specifically,the image processor 110 displays a screen corresponding to anapplication, a pointing cursor for controlling the application, and acontrol object for performing a predetermined function. The controlobject may include a virtual slider, a virtual button, and other variousgraphic user interfaces.

Meanwhile, the image processor 110 may include a display panel (notshown) achieved in the form of a liquid crystal display (LCD), anorganic light emitting diode (OLED), a plasma display panel (PDP), etc.,and a panel driver (not shown).

The user input unit 120 may receive a control command from the pointingdevice 150. To this end, the user input unit 120 may performwired/wireless communication such as infrared communication, Bluetoothcommunication, ZigBee communication, local area network communication,etc. Meanwhile, the control command may include at least one of apointing operation and a certain key input.

With a control method of the image processing apparatus 100 according tothe first exemplary embodiment, a first screen and a second screen maybe displayed overlapping each other. For example, the controller 130 maycontrol the image processor 110 so that the second screen correspondingto a second application can be displayed overlapping on the first screencorresponding to a first application, and a part of the second screen,overlapped with the first screen, can be displayed when the firstapplication is controlled.

In this case, the controller 130 may control the image processor 110 todisplay at least one of the pointing cursors for controlling theapplication, on at least one of the first screen and the second screen.

According to an exemplary embodiment, the pointing cursor may controlthe application corresponding to the most adjacent screen between theunderlying first screen and second screen displayed overlapping eachother. At this time, the pointing cursor is movable to at least onelocation of below the first screen, above the first screen, between thefirst and second screens, and above the second screen. If the pointingcursor is transferred to a different location, at least one of thetransparency, the shape, the brightness and the color of the pointingcursor may be changed, which will be described later with reference toFIGS. 2A to 2C.

According to another exemplary embodiment, the pointing cursor includesa first pointing cursor and a second pointing cursor, and the firstpointing cursor and the second pointing cursor may control the firstapplication and the second application, respectively. In this case, thefirst pointing cursor and the second pointing cursor may control theapplication corresponding to the most adjacent screen between theunderlying first and second screens displayed overlapping each otherwhen no screen is displayed corresponding to an application to becontrolled. When controlling another application other than theapplication subject to control, the first pointing cursor and the secondpointing cursor may be changed in at least one of the transparency, theshape, the brightness and the color thereof. Also, the first pointingcursor and the second pointing cursor are movable within a screen regioncorresponding to the application subject to the control. In this case,the first pointing cursor and the second pointing cursor may be changedin at least one of the transparency, the shape, the brightness and thecolor if transferred beyond a movable region, which will be describedwith reference to FIGS. 2D to 2F.

According to a method of controlling the image processing apparatus 100according to a second exemplary embodiment, the first screen and thesecond screen may be displayed without overlapping each other.Specifically, the controller 130 controls the image processor 110 todisplay the first screen corresponding to the first application and thesecond screen corresponding to the second application withoutoverlapping each other. The controller 130 also controls at least one ofthe first application and the second application, in which the imageprocessor 110 is controlled to make a user recognize that theapplication subject to the control is switched.

In this case, the controller 130 controls the image processor 110 todisplay at least one of the pointing cursors for controlling theapplications, on at least one of the first screen and the second screen.

According to an exemplary embodiment, the pointing cursor may controlthe application corresponding to the underlying-displayed first screenor the second screen. In this case, the pointing cursor is movable to atleast one location of above the first screen, below the first screen,above the second screen, and below the second screen. If the pointingcursor is transferred to a different location, at least one of thetransparency, the shape, the brightness and the color of the pointingcursor may be changed, which will be described later with reference toFIGS. 8A to 8B.

According to another exemplary embodiment, at least one pointing cursorincludes the first pointing cursor and the second pointing cursor, andthe first pointing cursor and the second pointing cursor may control thefirst application and the second application, respectively. In thiscase, the first pointing cursor and the second pointing cursor aremovable within the screen region corresponding to the applicationsubject to be controlled. Also, the first pointing cursor and the secondpointing cursor may be changed in at least one of the transparency, theshape, the brightness and the color if transferred beyond the movableregion, which will be described with reference to FIGS. 8C to 8D.

The pointing device 150 may include a mouse or a similar input unitbased on a cursor. The pointing device 150 can transmit a controlcommand input by a user to the image processing apparatus 100. To thisend, the pointing device 150 can perform wired and wirelesscommunication with the image processing apparatus 100.

In the meantime, there may be provided a plurality of pointing devices150.

The plurality of pointing devices 150 may be assigned to theapplications, respectively. For example, a pointing device A may beassigned to a broadcasting screen, and a pointing device B may beassigned to a game screen. In this case, a user employs the pointingdevice A to control a broadcasting view and the pointing device B toexecute the game.

Also, the plurality of pointing devices 150 may be assigned accordingnot to the respective applications, but to the applications where thepointing cursors of the pointing devices 150 are located. In moredetail, if the pointing cursor corresponding to the pointing device 150is placed in a certain screen, the pointing device 150 can be assignedto the application corresponding to the certain screen. For instance,the pointing device A may be assigned to the broadcasting screen or thegame screen in accordance with the location of the pointing cursor A. Ifthe pointing cursor A is located in a place where the broadcastingscreen and the game screen are overlapped with each other, it ispossible to control the application corresponding to the most adjacentscreen among the underlying screens.

Below, the method of controlling the image processing apparatusaccording to the first exemplary embodiment will be described withreference to FIGS. 2A to 2F.

In the case that a game application and a broadcasting application aresimultaneously executed in the DTV, screens corresponding to therespective applications may be displayed at a time.

In the method of controlling the image processing apparatus 100according to the first exemplary embodiment, the first screen and thesecond screen may be displayed overlapping each other. Specifically, asshown in FIGS. 2A to 2F, a broadcasting screen 220 corresponding to thebroadcasting application may be displayed overlapping on a game screen210 corresponding to the game application. In this case, at least onepointing cursor for controlling the application may be displayed on atleast one of the first and second screens. At least one pointing cursormay each correspond to at least one pointing device.

FIG. 2A illustrates that one pointing cursor is displayed.

A pointing cursor 231 corresponds to a pointing device A 230.

If the pointing device A 230 is assigned to the game screen 210 or thebroadcasting screen 220 on the basis of the location of the pointingcursor 231, the pointing cursor 231 can control the applicationcorresponding to the most adjacent screen between the underlying gamescreen 210 and broadcasting screen 220 displayed overlapping each other.Referring to FIG. 2A, a background->the game screen 210->thebroadcasting screen 220->the pointing cursor 231 are arranged insequence from a bottom layer to a top layer. In this case, thebroadcasting screen 220 is a screen most adjacent to the pointing cursor231 among the screens displayed under the pointing cursor 231 andoverlapping one another. Therefore, the pointing cursor 231 can controlthe broadcasting screen 220.

FIG. 2B illustrates that the form of the pointing cursor is changed whenthe pointing cursor is moved between the applications.

The pointing cursors 232, 233, 234, 235 and 236 may move between thegame screen 210 and the broadcasting screen 220. Specifically, thepointing cursors 232, 233, 234, 235 and 236 may be moved to at least onelocation of below the game screen 210, above the game screen 210,between the game screen 210 and the broadcasting screen 220, and abovethe broadcasting screen 220. Further, the pointing cursor 232, 233, 234,235 and 236 may be changed in at least one of the transparency, theshape, the brightness and the color as being moved from one location toanother.

As shown in FIG. 2B, the brightness of the pointing cursor 232, 233,234, 235, 236 becomes lower as it is being moved onto the lower layer.For example, in the case where the pointing cursor 232 moves from thebroadcasting screen 220 to the game screen 210, it is changed into thepointing cursor 234 of which the brightness is lowered by apredetermined level. Further, if the pointing cursor 234 located on thegame screen 210 is transferred below the game screen 210, it is changedinto the pointing cursor 236 of which the brightness is lowered by apredetermined level.

Meanwhile, the pointing cursor 232 located on the broadcasting screen220 may be moved between the game screen 210 and the broadcasting screen220. In this case, the background->the game screen 210->the pointingcursors 233 and 234->the broadcasting screen 220 are arranged insequence from the bottom layer to the top layer. Thus, the pointingcursor 234 located on the game screen 210 and the pointing cursor 233located between the game screen 210 and the broadcasting screen 220 areprovided on the same layer. However, differently from the formerpointing cursor 234, because the latter pointing cursor 233 exists in aregion where the game screen 210 and the broadcasting screen 220 overlapeach other, the latter pointing cursor 233 is covered with thebroadcasting screen 220. To display this, the outline of the pointingcursor 233 may be displayed in the form of a dotted line when beinglocated between the game screen 210 and the broadcasting screen 220.However, since the former pointing cursor 234 and the latter pointingcursor 233 are provided on one layer, they have the same brightness.

Likewise, the pointing cursor 236 located under the game screen 210 andthe pointing cursor 235 located between the background and the gamescreen 210 can be displayed having the same brightness, and the outlineof the latter 235 can be displayed in the form of the dotted line.

If the pointing device A 230 is assigned to the game screen 210 or thebroadcasting screen 220 on the basis of the location of the pointingcursor 232, 233, 234, 235, 236, the pointing cursor 232, 233, 234, 235,236 controls the application corresponding to the most adjacent screenbetween the game screen 210 and the broadcasting screen 220 thatunderlies the pointing cursor 232, 233, 234, 235, 236. Specifically,referring to FIG. 2B, the pointing cursor 232 located on thebroadcasting screen 220 can control the broadcasting screen 220. Thepointing cursor 234 located on the game screen 210 and the pointingcursor 233 located between the game screen 210 and the broadcastingscreen 220 can control the game screen 210. However, the pointing cursor236 located below the game screen 210 and the pointing cursor 235located between the background and the game screen 210 do not have anytarget to control.

Meanwhile, in the case of FIG. 2B, even though the pointing cursors 232,233, 234, 235 and 236 move between the game screen 210 and thebroadcasting screen 220, the game screen 210 and the broadcasting screen220 are continuously displayed and do not disappear. Also, in the caseof controlling the game screen 210, the broadcasting screen 220displayed on a relatively upper layer is displayed as it is and does notdisappear.

FIG. 2C illustrates that two pointing cursors are displayed.

The pointing cursor A 237 corresponds to the pointing device A 230, andthe pointing cursor B 241 corresponds to the pointing device B 240. InFIG. 2C, the pointing cursor A 237 and the pointing cursor B 241 aredisplayed on the game screen 210.

If the pointing device A 230 and the pointing device B 240 are assignedto the game screen 210 or the broadcasting screen 220 on the basis ofthe locations of the pointing cursor A 237 and the pointing cursor B241, respectively, the pointing cursor A 237 and the pointing cursor B241 can control the application corresponding to the most adjacentscreen between the game screen 210 and the broadcasting screen 220 thatunderlies the pointing cursor A 237 and the pointing cursor B 241.

Referring to FIG. 2C, the background->the game screen 210->the pointingcursor A 237, the pointing cursor B 241->the broadcasting screen 220 arearranged in sequence from the bottom layer to the top layer. In thiscase, the game screen 210 is the most adjacent screen to the pointingcursor A 237 among the screens underlying the pointing cursor A 237 andoverlapping each other. Also, the game screen 210 is the most adjacentscreen to the pointing cursor B 241 among the screens underlying thepointing cursor B 241. Thus, both the pointing cursor A 237 and thepointing cursor B 241 can control the game screen 210. For example, aplurality of users can play a game together.

FIG. 2D illustrates that a plurality of applications are controlled by aplurality of pointing devices, respectively.

If the pointing device A 230 is assigned to the game screen 210 and thepointing device B 240 is assigned to the broadcasting screen 220, thepointing cursor A 238 can control the game screen 210 and the pointingcursor B 242 can control the broadcasting screen 220. Referring to FIG.2D, the background->the game screen 210->the pointing cursor A 238->thebroadcasting screen 220->the pointing cursor B 242 are arranged insequence from the bottom layer to the top layer. Thus, the pointingcursor B 242 is located in a region where the game screen 210 and thebroadcasting screen 220 overlap each other. However, since the pointingcursor B 242 can control only the broadcasting screen 220, the gamescreen 210 is not controlled by a user manipulating the pointing cursorB 242. In this case, only the broadcasting screen 220 is controllable.

On the other hand, if the pointing device B 240 is assigned to the gamescreen 210 and the pointing device A 230 is assigned to the broadcastingscreen 220, the pointing cursor B 242 can control the game screen 210and the pointing cursor A 238 can control the broadcasting screen 220.Referring to FIG. 2D, the pointing cursor B 242 is located in the regionwhere the game screen 210 and the broadcasting screen 220 overlap eachother. However, since the pointing cursor B 242 can control only thegame screen 210, the broadcasting screen 220 is not controlled eventhough a user manipulates the pointing cursor B 242. The pointing cursorA 238 is located beyond the broadcasting screen 220. Because thepointing cursor A 238 can control only the broadcasting screen 220, thegame screen 210 is not controlled even though a user manipulates thepointing cursor A 238.

FIG. 2E shows a display in which a screen corresponding to anapplication subject to control is not yet displayed.

In FIG. 2E, the broadcasting screen 220 subject to the control of thepointing device B 240 is not yet displayed. For example, there may be acase in which broadcasting contents are being loaded. In this case, thepointing cursor B 243 has no target to be controlled. Thus, the pointingcursor B 243 may control an application corresponding to the mostadjacent screen among the screens underlying the pointing cursor B 243and overlapping each other besides the broadcasting screen 220.Referring to FIG. 2E, the background->the game screen 210->the pointingcursor A 238->the broadcasting screen 220->the pointing cursor B 243 arearranged in sequence. Thus, the pointing cursor B 243 can control thegame screen 210 since the game screen 210 is the most adjacent screenamong the screens underlying the pointing cursor B 243 and overlappingeach other.

In the meantime, if the pointing cursor B 243 controls the game screen210 other than the broadcasting screen 220 subject to the control, theoutline of the pointing cursor B 243 may be displayed in the form of adotted line.

FIG. 2F illustrates a region where the pointing cursor is movable.

The pointing cursor A 238 is movable within the region of the gamescreen 210 subject to the control thereof. Likewise, the pointing cursorB 242 is movable within the region of the broadcasting screen 220subject to the control thereof. That is, as shown in FIG. 2F, thepointing cursor A 238 is movable within the region A, and the pointingcursor B 242 is movable within the region B.

In this case, if the pointing cursor A 238 and the pointing cursor B 242are located beyond their respective movable regions, the outlinesthereof may be changed into the dotted line. Referring to FIG. 2F, theoutlines of the pointing cursor A 238′ located beyond the region A andthe pointing cursor B 242′ located beyond the region B are displayed inthe form of the dotted line.

Below, a method of controlling the image processing apparatus accordingto an exemplary embodiment will be described in more detail.

FIG. 3 shows a configuration of layers according to an exemplaryembodiment.

A layer or a graphic layer is a plane where an image is located. On thelayer are located a screen corresponding to an application, a pointingcursor corresponding to a pointing device, a control object forperforming a predetermined function, etc.

A content layer is a layer where a screen corresponding to anapplication is located. A cursor layer is a layer where a pointingcursor corresponding to a pointing device is located. A control objectlayer is a layer where a control object for performing a predeterminedfunction is located.

The screen, the pointing cursor and the control object undergo differentimage processes, respectively. Thus, the image processing apparatus 100individually processes the screen, the pointing cursor and the controlobject and displays them on the corresponding layers, respectively, inwhich the plurality of layers are arranged overlapping each other. Inthis case, it looks to a user that the pointing cursor and the controlobject overlap each other on the screen.

In general, under environments of the existing PC, e.g., under windowenvironments of Microsoft operating system (MS_OS) or Linux, the cursorlayer is set on a topmost graphic layer. In this case, it is determinedwhether to perform execution by calculating coordinates that the cursorindicates on activated content among the programs executed in the lowerlayers. Generally, the activated content is a program located directlybeneath the cursor layer. That is, it is generally possible to controlonly the program located directly beneath the cursor because only onecursor layer is set.

On the other hand, in this exemplary embodiment, the cursor layers areset corresponding to content layers. Therefore, it is possible tosimultaneously control a plurality of applications.

However, the cursor layers are set corresponding to the content layers,but the cursor may be set corresponding to the contents or may not beset corresponding to the contents. For example, as described withreference to FIGS. 2A to 2C, the cursor may be set in accordance withthe application where the cursor is located. Also, as described withreference to FIGS. 2D to 2F, the cursor may be set in accordance withthe application.

The cursor layer is located on top of the corresponding content layer.Specifically, as shown in FIG. 3, a cursor A layer 320 is located on topof a content A layer 310, and a cursor B layer 340 is located on top ofa content B layer 330. In this case, a user controls the contentsdisplayed on the content A layer 310 through the cursor displayed on thecursor A layer 320, and controls the contents displayed on the content Blayer 330 through the cursor displayed on the cursor B layer 340.

Meanwhile, the content displayed on each content layer does not alwaysuse the full layer, but may use only a portion of the layer. Forexample, the screen or the cursor may be displayed in only a part of adisplay unit. At this time, a region in which the cursor displayed oneach cursor layer is movable may be limited to a content regiondisplayed on the corresponding content layer. For instance, the cursordisplayed on the cursor A layer 320 is movable within only the contentregion displayed on the content A layer 310, and the cursor displayed onthe cursor B layer 340 is movable within only the content regiondisplayed on the content B layer 330.

The cursor displayed on a cursor layer other than the topmost cursorlayer may be covered with the contents, the cursor or the like displayedon an upper layer. In this case, the position of the cursor located onthe lower layer may be displayed in the form of a translucent, opaque,transparent or other symbol, or may not be displayed. For example, thecursor displayed on the cursor A layer 320 may be displayedtransparently or not displayed as being covered with the contentsdisplayed on the content B layer 330.

FIG. 4A illustrates a configuration of a layer according to anotherexemplary embodiment.

A control object layer is located between a relevant content layer and arelevant cursor layer. Specifically, as shown in FIG. 4A, a controlobject layer (Layer #2) 420 where a control object is displayed islocated between a content layer (Layer #1) 410 where a corresponding TVimage is displayed and a cursor layer (Layer #3) 430 where acorresponding cursor is displayed.

In this case, the cursor layer 430 is located on the top, the controlobject layer 420 is located in the middle, and the content layer 410 islocated on the bottom. Here, the higher the number, the higher thelayer.

A user can control a predetermined function related to a contentdisplayed on the content layer 410 through the control object displayedon the control object layer 420. In more detail, the control object iscontrolled through the cursor displayed on the cursor layer 430, therebycontrolling a predetermined function of the content.

Meanwhile, according to a modified exemplary embodiment, the controlobject may be included in the content layer without any separate controlobject layer. In this case, a user may use the cursor and directlyexecute the control object displayed on the content layer correspondingto the cursor. For example, if a screen-control user interface isincluded in a game screen, a user may use the cursor and directlycontrol the control object displayed on the content layer.

FIG. 4B shows a screen displayed in the case of FIG. 4A.

If a user watches TV while controlling a channel, volume, etc. throughthe pointing device A, the cursor A 440 corresponding to the pointingdevice A, a control object (VOL) 450 for performing volume control, anda control object (CH) 460 for performing channel change are displayed ona TV screen 415.

In the case that a user controls the cursor A 440 through the pointingdevice A, for example, if a pointing operation is performed through abutton, a touch pad, etc. provided in the pointing device A, thecontroller 130 recognizes two-dimensional coordinates (x, y) on thecursor layer 430 where the cursor A 440 is located. At this time, thecontroller 130 executes the control object corresponding to thetwo-dimensional coordinates (x, y) of the recognized cursor A 440 amongthe control objects (e.g., VOL 450 and CH 460) provided on the controlobject layer 420.

FIG. 5A illustrates a configuration of a layer according to stillanother exemplary embodiment.

Referring to FIG. 5A, the pointing device A and the pointing device Bare connected to the image processing apparatus 100. For example, thecursor A 580 corresponding to the pointing device A may be displayed onthe layer #3 530, and the cursor B 590 corresponding to the pointingdevice B may be displayed on the layer #5 550.

However, contents are not yet displayed on the content layer 540corresponding to the layer #5 550.

For instance, while a user A controls a broadcasting screen through thepointing device A, a user B can execute a game through the pointingdevice B. When a user B newly connects the pointing device B to theimage processing apparatus 100 being controlled by the existing pointingdevice A, the cursor B 590 corresponding to the pointing device B isdisplayed on the layer #5 550 provided above the layer #3 530 where theexisting cursor A 580 is located. Then, the game contents will be loadedand displayed onto the layer #4 540, but nothing is currently displayedon the layer #4 540. In this case, since there is no content displayedon the control object layer or the content layer corresponding to thecursor B 590 before loading and displaying the game contents, thecurrent cursor B 590 has no target to be controlled. Thus, the cursor B590 may search the lower layers and control the control object providedin the layer #2 520 or the broadcasting image displayed on the layer #1510.

In the case of using the cursor B 590 corresponding to the layer #4 540to control the control object displayed on the layer #2 520, the imageprocessing apparatus 100 executes the control object on the layer #2 520corresponding to the coordinates (x, y) of the cursor B displayed on thelayer #5 550. If a user selects and executes a game 564 through thecursor B 590 as shown in FIG. 5B, game contents are loaded and a gamescreen is displayed. In this case, the game screen is displayed on thecontent layer or control object layer corresponding to the layer #5 550so that it can be controlled by the cursor B 590 displayed on the layer#5 550. In FIG. 5A, the game screen will be displayed below the layer #5550, i.e., on the layer #4 540.

In this exemplary embodiment, the cursor A 580 is movable on a fulltwo-dimensional space of the layer #3 530, but the cursor B 590 may bemovable within a limited range of the two-dimensional space of the layer#5 550, i.e., within a space corresponding to coordinates where thecontents are located actually. This is convenient in light ofcontrolling the cursor. That is, if a two-dimensional size of contentslocated on an upper content layer is smaller than that of contentslocated on the lower content layer, it is more convenient from the pointof view of control that a space where an upper cursor is movable islimited to the size of the corresponding contents.

Meanwhile, the cursor A 580 displayed on the layer #3 530 may be locatedwithin a content region displayed on the layer #4 540. For example, thecursor A 580 may be located in a region where the broadcasting screendisplayed on the layer #1 510 and the game screen displayed on the layer#4 540 overlap each other. At this time, the cursor A 580 cannot controlthe game screen displayed on the layer #4 540 because it is located onthe cursor layer 530 corresponding to the layer #1 510. Here, the cursorA 580 may be displayed translucently together with the game screen ofthe upper content layer, or a virtual cursor may be displayed in theform of a specific symbol or shape instead of the cursor A 580. Thus, auser can easily determine in which layer the cursor A 580 is located.However, the virtual cursor is not the real cursor but a cursor of thelower layer, which is displayed as an image on the upper layer.Accordingly, the selection or execution is not performed even if thecontent or control object displayed on the upper layer is controlledthrough the virtual cursor.

FIG. 5B shows a screen displayed in the case of FIG. 5A.

Since the game screen is not yet displayed on the layer #4 540, only onescreen, i.e., the broadcasting screen 515 is being displayed. Further,the control objects (i.e., TV 562, GAME 564, DVD 566, VOL 572, CH 574)for performing predetermined functions to be implemented on thebroadcasting screen 515, the cursor A 580 and the cursor B 590 aredisplayed on the broadcasting screen 515.

FIG. 6A shows a configuration of layers according to still anotherexemplary embodiment, and FIG. 6B shows a screen displayed in the caseof FIG. 6A.

When game contents are loaded in a layer state of FIG. 5A, a game screenmay be displayed on the content layer (layer #4) 640 as shown in FIG.6A. In other words, the game screen is displayed on the layer #4 640corresponding to the layer #5 650 where the cursor B 690 is displayed.

In this case, a user can control the game screen 670 through the cursorB 690 as shown in FIG. 6B. Also, a broadcasting screen 615 or thecontrol objects (VOL) 662 and (CH) 664 can be controlled through thecursor A 680.

FIG. 7A shows a configuration of layers according to still anotherexemplary embodiment, and FIG. 7B shows a screen displayed in the caseof FIG. 7A.

A user may control a game screen 760 through a cursor A 770 located onthe layer #3 740. A user may not control broadcasting screen 715 byusing cursor A 770.

In FIG. 6A, the game screen 670 is controlled through the cursor B 690.Thus, the game screen 670 is displayed on the layer #4 640 correspondingto the layer #5 650 where the cursor B 690 is displayed.

However, in the exemplary embodiment of FIGS. 7A and 7B, the game screen760 is controlled through the cursor A 770, so that the game screen 760may be loaded into the layer #2.5 730 between the layer #3 740 and thelayer #2 720 as shown in FIG. 7A. Accordingly, to control a new contentlayer through a cursor on a certain cursor layer, the newly createdcontent layer may be located below the certain cursor layer. Further, ifthe new content layer overlaps with the control object located below thecertain cursor layer, a control object of an upper content layer may beexecuted.

In this case, a user may control the game screen 760 through the cursorA 770 as shown in FIG. 7B.

Below, a method of controlling the image processing apparatus 100according to a second exemplary embodiment will be described withreference to FIGS. 8A to 8D.

In the method of controlling the image processing apparatus 100according to the second exemplary embodiment, a first screen and asecond screen may be displayed not to overlap each other. Specifically,as shown in FIGS. 8A to 8D, a game screen 810 and a broadcasting screen820 may be displayed independently of each other. In this case, at leastone pointing cursor for controlling an application may be displayed onat least one of the game screen 810 and the broadcasting screen 820. Atleast one pointing cursor may correspond to at least one pointingdevice, respectively.

FIG. 8A shows that one pointing cursor is displayed.

A pointing cursor 831 corresponds to a pointing device A 830.

If the pointing device A 830 is assigned to the game screen 810 or thebroadcasting screen 820 on the basis of the location of the pointingcursor 831, the pointing cursor 831 can control the game screen 810 orbroadcasting screen 820 displayed underlying the pointing cursor 831.

In FIG. 8A, the screen displayed underlying the pointing cursor 831 isthe broadcasting screen 820. Therefore, the pointing cursor 831 cancontrol the broadcasting screen 820.

FIG. 8B illustrates that the form of the pointing cursor may be changedas it is moved between applications.

The pointing cursors 832, 832′ may be moved between the game screen 810and the broadcasting screen 820. Specifically, the pointing cursors 832,832′ is movable to at least one location of above the game screen 810,below the game screen 810, above the broadcasting screen 820, and belowthe broadcasting screen 820. If the pointing cursor 832, 832′ is movedfrom one of these locations to another, at least one of thetransparency, the shape, the brightness and the color of the pointingcursor 832, 832′ may be changed.

If the pointing device A 830 is assigned to the game screen 810 or thebroadcasting screen 820 on the basis of the location of the pointingcursor 831, and the pointing cursor 832 is located on the broadcastingscreen 820 as shown in FIG. 8B, the pointing cursor 832 can control thebroadcasting screen 820.

However, if the pointing cursor 832′ moves below the game screen 810,the pointing cursor 832′ cannot control the game screen 810. In thiscase, the pointing cursor 832′ may be displayed transparently as beingcovered by the game screen 810.

FIG. 8C illustrates a display in which a plurality of applications arecontrolled by a plurality of pointing devices, respectively.

The pointing cursor A 833 corresponds to the pointing device A 830, andthe pointing cursor B 841 corresponds to the pointing device B 840.

If the pointing device A 830 is assigned to the game screen 810 and thepointing device B 840 is assigned to the broadcasting screen 820, thepointing cursor A 833 can control the game screen 810 and the pointingcursor B 841 can control the broadcasting screen 820. Referring to FIG.8C, the pointing cursor A 833 and the pointing cursor B 841 are locatedwithin the regions of the game screen 810 and the broadcasting screen820 to be controlled, respectively. Thus, the pointing cursor A 833 andthe pointing cursor B 841 can control the game screen 810 and thebroadcasting screen 820, respectively.

On the other hand, if the pointing device B 840 is assigned to the gamescreen 810 and the pointing device A 830 is assigned to the broadcastingscreen 820, the pointing cursor B 841 can control the game screen 810and the pointing cursor A 833 can control the broadcasting screen 820.Referring to FIG. 8C, the pointing cursor A 833 is located on the gamescreen 810. That is, since the pointing cursor A 833 is located beyondthe region of the broadcasting screen 820 to be controlled, it cannotcontrol the broadcasting screen 820. Also, the pointing cursor B 841 islocated on the broadcasting screen 820. That is, since the pointingcursor B 841 is located beyond the region of the game screen 810 to becontrolled, it cannot control the game screen 810.

FIG. 8D shows that the form of the pointing cursor may be changed whenmoved beyond a target to be controlled.

If the pointing device A 830 is assigned to the game screen 810 and thepointing device B 840 is assigned to the broadcasting screen 820, thepointing cursor A 834 can move within the region of the game screen 810to be controlled. Further, the pointing cursor B 842 can move within theregion of the broadcasting screen 820 to be controlled. In this case,the outline of the pointing cursor A 834 and the pointing cursor B 842may be changed in the form of a dotted line if pointing cursor A 834 andpointing cursor B 842 are moved beyond their respective movable region.Referring to FIG. 8D, the outline of the pointing cursor A 834, whichhas been moved beyond the region of the game screen 810, and the outlineof the pointing cursor B 842, which has been moved beyond the region ofthe broadcasting screen 820, are displayed in the form of a dotted line.

FIG. 9 is a control flowchart of an image processing apparatus accordingto a first exemplary embodiment.

At operation S901, the image processing apparatus 100 displays a firstscreen corresponding to a first application.

At operation S902, the image processing apparatus 100 displays a secondscreen corresponding to a second application above the first screen, inwhich the second screen and the first screen overlap each other.

At operation S903, the image processing apparatus 100 displays a part ofthe second screen, overlapped with the first screen, while controllingthe first application.

FIG. 10 is a control flowchart of an image processing apparatusaccording to a second exemplary embodiment.

At operation S1001, the image processing apparatus 100 displays a firstscreen corresponding to a first application and a second screencorresponding to a second application so that the first screen andsecond screen do not overlap each other.

At operation S1002, the image processing apparatus 100 controls at leastone of the first application and the second application.

At operation S1003, the image processing apparatus 100 displays theapplication to be recognized by a user when the application subject tothe control is switched.

As described above, in the case that a plurality of applications aresimultaneously running under environment of a DTV or a PC, therespective applications can be controlled at the same time through asingle or plurality of input devices, and the cursors for simultaneouslycontrolling the plurality of applications can be displayed.

Also, in the case that a plurality of contents are controlled throughthe plurality of input devices at the same time, there can be provided auser interface intuitively controllable by a user. Further, a systemsimultaneously controllable by several users can be achieved in onecomputer device having a display unit.

Although a few exemplary embodiments have been shown and described, itwill be appreciated by those skilled in the art that changes may be madein these embodiments without departing from the principles and spirit ofthe invention, the scope of which is defined in the appended claims andtheir equivalents.

What is claimed is:
 1. A method of controlling an image processingapparatus, the method comprising: displaying a first screencorresponding to a first application and a second screen correspondingto a second application, such that the first screen and the secondscreen do not overlap; controlling at least one of the first applicationand the second application; and if the controlled at least one of thefirst and the second applications is changed, displaying the firstscreen and the second screen to identify the controlled at least one ofthe first and the second applications.
 2. The method according to claim1, wherein at least one pointing cursor for controlling at least one ofthe first application and the second application is displayed on atleast one of the first screen and the second screen.
 3. The methodaccording to claim 2, wherein the at least one pointing cursor controlsat least one of the first application and the second applicationcorresponding to one of the first screen and the second screen that aredisplayed underlying the at least one pointing cursor.
 4. The methodaccording to claim 2, wherein the at least one pointing cursor ismovable to at least one location of above the first screen, below thefirst screen, above the second screen, and below the second screen. 5.The method according to claim 4, wherein the at least one pointingcursor is changed in at least one of transparency, shape, brightness andcolor if the at least one cursor is moved from a first location to asecond location that is different from the first location.
 6. The methodaccording to claim 2, wherein the at least one pointing cursorrespectively corresponds to at least one pointing device.
 7. The methodaccording to claim 2, wherein the at least one pointing cursor comprisesa first pointing cursor and a second pointing cursor, and the firstpointing cursor and the second pointing cursor control the firstapplication and the second application, respectively.
 8. The methodaccording to claim 7, wherein the first pointing cursor is movablewithin a region of the first screen corresponding to the firstapplication, and the second pointing cursor is movable within a regionof the second screen corresponding to the second application.
 9. Themethod according to claim 8, wherein the first pointing cursor and thesecond pointing cursor are changed in at least one of transparency,shape, brightness and color when moved beyond the region of the firstscreen and the region of the second screen, respectively.
 10. The methodaccording to claim 7, wherein the first pointing cursor and the secondpointing cursor correspond to a first pointing device and a secondpointing device, respectively.
 11. An image processing apparatuscomprising: an image processor which processes and displays an image;and a controller which controls the image processor to display a secondscreen corresponding to a second application above and overlapping atleast a portion of a first screen corresponding to a first application,and to display at least a portion of the second screen that overlaps thefirst screen, when controlling the first application, wherein thecontroller controls the image processor to display at least one pointingcursor for controlling at least one of the first application and thesecond application, on at least one of the first screen and the secondscreen, and wherein the at least one pointing cursor controls at leastone of the first application and the second application corresponding toone of the first screen and the second screen that underlies and is mostadjacent to the at least one pointing cursor.
 12. An image processingapparatus comprising: an image processor which processes and displays animage; and a controller which controls the image processor to display asecond screen corresponding to a second application above andoverlapping at least a portion of a first screen corresponding to afirst application, and to display at least a portion of the secondscreen that overlaps the first screen, when controlling the firstapplication, wherein the controller controls the image processor todisplay at least one pointing cursor for controlling at least one of thefirst application and the second application, on at least one of thefirst screen and the second screen, and wherein the at least onepointing cursor is movable to at least one location of below the firstscreen, above the first screen, between the first and second screens,and above the second screen.
 13. The image processing apparatusaccording to claim 12, wherein the at least one pointing cursor ischanged in at least one of transparency, shape, brightness and color ifthe at least one cursor is moved from a first location to a secondlocation that is different from the first location.
 14. An imageprocessing apparatus comprising: an image processor which processes anddisplays an image; and a controller which controls the image processorto display a second screen corresponding to a second application aboveand overlapping at least a portion of a first screen corresponding to afirst application, and to display at least a portion of the secondscreen that overlaps the first screen, when controlling the firstapplication, wherein the controller controls the image processor todisplay at least one pointing cursor for controlling at least one of thefirst application and the second application, on at least one of thefirst screen and the second screen, and wherein the at least onepointing cursor respectively corresponds to at least one pointingdevice.
 15. An image processing apparatus comprising: an image processorwhich processes and displays an image; and a controller which controlsthe image processor to display a second screen corresponding to a secondapplication above and overlapping at least a portion of a first screencorresponding to a first application, and to display at least a portionof the second screen that overlaps the first screen, when controllingthe first application, wherein the controller controls the imageprocessor to display at least one pointing cursor for controlling atleast one of the first application and the second application, on atleast one of the first screen and the second screen, and wherein the atleast one pointing cursor comprises a first pointing cursor and a secondpointing cursor, and the first pointing cursor and the second pointingcursor control the first application and the second application,respectively.
 16. The image processing apparatus according to claim 15,wherein if one of the first screen and the second screen is notdisplayed, the first pointing cursor or the second pointing cursorcorresponding to the non-displayed one of the first screen and thesecond screen controls an application corresponding to a displayed oneof the first screen and the second screen that underlies and is mostadjacent to the first pointing cursor or the second pointing cursorcorresponding to the non-displayed one of the first screen and thesecond screen.
 17. The image processing apparatus according to claim 16,wherein the first pointing cursor and the second pointing cursor arechanged in at least one of transparency, shape, brightness and colorwhile the first pointing cursor or the second pointing cursor controlthe application corresponding to the displayed one of the first screenand the second screen that underlies and is most adjacent to the firstpointing cursor or the second pointing cursor corresponding to thenon-displayed one of the first screen and the second screen.
 18. Theimage processing apparatus according to claim 15, wherein the firstpointing cursor is movable within a region of the first screencorresponding to the first application, and the second pointing cursoris movable within a region of the second screen corresponding to thesecond application.
 19. The image processing apparatus according toclaim 18, wherein the first pointing cursor and the second pointingcursor are changed in at least one of transparency, shape, brightnessand color when moved beyond the region of the first screen and theregion of the second screen, respectively.
 20. The image processingapparatus according to claim 15, wherein the first pointing cursor andthe second pointing cursor correspond to a first pointing device and asecond pointing device, respectively.
 21. An image processing apparatuscomprising: an image processor which processes and displays an image;and a controller which controls the image processor to display a firstscreen corresponding to a first application and a second screencorresponding to a second application, such that the first screen andthe second screen do not overlap, controls at least one of the firstapplication and the second application, and controls the imageprocessor, if the controlled at least one of the first application andthe second application is changed, to display the first screen and thesecond screen to identify the controlled at least one of the firstapplication and the second application.
 22. The image processingapparatus according to claim 21, wherein the controller controls theimage processor to display at least one pointing cursor for controllingat least one of the first application and the second application on atleast one of the first screen and the second screen.
 23. The imageprocessing apparatus according to claim 22, wherein the at least onepointing cursor controls at least one of the first application and thesecond application corresponding to one of the first screen and thesecond screen that are displayed underlying the at least one pointingcursor.
 24. The image processing apparatus according to claim 22,wherein the at least one pointing cursor is movable to at least onelocation of above the first screen, below the first screen, above thesecond screen, and below the second screen.
 25. The image processingapparatus according to claim 24, wherein the at least one pointingcursor is changed in at least one of transparency, shape, brightness andcolor if the at least one cursor is moved from a first location to asecond location that is different from the first location.
 26. The imageprocessing apparatus according to claim 22, wherein the at least onepointing cursor respectively corresponds to at least one pointingdevice.
 27. The image processing apparatus according to claim 22,wherein the at least one pointing cursor comprises a first pointingcursor and a second pointing cursor, and the first pointing cursor andthe second pointing cursor control the first application and the secondapplication, respectively.
 28. The image processing apparatus accordingto claim 27, wherein the first pointing cursor is movable within aregion of the first screen corresponding to the first application, andthe second pointing cursor is movable within a region of the secondscreen corresponding to the second application.
 29. The image processingapparatus according to claim 28, wherein the first pointing cursor andthe second pointing cursor are changed in at least one of transparency,shape, brightness and color when moved beyond the region of the firstscreen and the region of the second screen, respectively.
 30. The imageprocessing apparatus according to claim 27, wherein the first pointingcursor and the second pointing cursor correspond to a first pointingdevice and a second pointing device, respectively.
 31. The imageprocessing apparatus according to claim 16, wherein the applicationcorresponding to one of the first screen and the second screen thatunderlies and is most adjacent to the first pointing cursor or thesecond pointing cursor corresponding to the non-displayed one of thefirst screen and the second screen is one of the first application andthe second application.
 32. A method of controlling an image processingapparatus, the method comprising: displaying a first screencorresponding to a first application; displaying a second screencorresponding to a second application above the first screen such thatthe second screen overlaps at least a portion of the first screen; anddisplaying at least a portion of the second screen that overlaps theportion of the first screen, while controlling the first application,wherein at least one pointing cursor for controlling at least one of thefirst application and the second application is displayed on at leastone of the first screen and the second screen, wherein the at least onepointing cursor comprises a first pointing cursor and a second pointingcursor, and the first pointing cursor and the second pointing cursorcontrol the first application and the second application, respectively,wherein if one of the first screen and the second screen is notdisplayed, the first pointing cursor or the second pointing cursorcorresponding to the non-displayed one of the first screen and thesecond screen controls an application corresponding to a displayed oneof the first screen and the second screen that underlies and is mostadjacent to the first pointing cursor or the second pointing cursorcorresponding to the non-displayed one of the first screen and thesecond screen, and wherein the application corresponding to one of thefirst screen and the second screen that underlies and is most adjacentto the first pointing cursor or the second pointing cursor correspondingto the non-displayed one of the first screen and the second screen isone of the first application and the second application.